Markov model

A Markov model is a stochastic process where the probability of each step in the sequence is dependent only on the previous step, or in the case of higher-order Markov models the last n-steps. Markov models are frequently shown as matrices where each entry in the matrix M_ik represents the conditional probability that if the current state is i, then the next state will be k.